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DETAILED ACTION 



Information Disclosure Statement 
1. The references listed in the Information Disclosure Statement submitted on 04/02/2001 
and 04/02/2003 have been considered by the examiner (see attached PTO-1449). 




Specification and Drawing 

2. The disclosure is objected to because of the following: 

a. On page 12, lines 20-22, the equation is not clearly defined, because there is only 
one item in the expression of max { } and variables a<p,k and dk are not defined or described, and 
the similar situations are also found on page 15, lines 10, 16 and 17. Appropriate correction is 
required. 

b. On page 14, lines 1-8, the description appears to show certain relationship 
between Fig. 2 and Figure 4b, however the two figures appear to show different types of trees, 
since Fig. 4b has no edge between the nodes in the same level. Further, in Fig. 4b, there is no 
label indicating "increasing order within a given column" as described in the specification. 
Appropriate correction on specification and/or drawing is required. 

c. On page 14, lines 10-18, the algorithm is not clearly defined, because the meaning 
of "the smallest ranked node" and variable "n" are not described. Appropriate correction is 
required. The examiner suggests using the tree on the right side of Fig. 2 to show how the 
traversal algorithm works and/or explain what difference between the claimed algorithm and 
conventional depth-first traversal (pre-order, in-order, post order) and/or breath-first traversal. 
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d. According to page 17, lines 9-22, the trees 74 and 76 in Fig. 4a should be same as 
tree 72 for consistence, but they are not. Appropriate correction is required. 

e. Multiple typographical errors are found, such as on page 10, line 21, "set of 
appears to be "set or"; on page 20, line 13, "160 - 30 = 160" should be "160 - 30 = 130" and on 
page 30, line 17, a duplicated phrase "wherein said" should be deleted. Appropriate correction is 
required. 

Concerning multiple errors found in the application as stated above, the applicant's 
cooperation is requested in correcting any errors of which applicant may become aware in the 
application. It is remained that there is no new subject matter allowed. 

Claim Objections 

3. The specification is objected to as failing to provide proper antecedent basis for the 
claimed subject matter. See 37 CFR 1.75(d)(1) and MPEP § 608.01(o). Correction of the 
following is required: 

Regarding claim 1, the limitation of "a set of traversal rules" lacks antecedent bases 
and/or clear description in the specification (the closet disclosure is referred on page 5, line 17). 
Further, the limitation of "notes of a given generation are processed before the parent nodes of 
said given generation are processed" and "the deepest child generation is processed first" are 
contradictory to certain part of the specification (page 18, line 17 through page 22, linel6), 
which suggests the search algorithm starts from root to leaves. The claimed limitation(s), at 
least, does not clearly distinct and/or specify the two different situations. Moreover, the 
limitation of "the deepest child generation is processed first" appears to be not common approach 
of conventional traversal algorithms in the art, it must be clearly described, also, its required 
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condition(s) must be given. Otherwise, for example, traversing the tree shown in Fig. 2 for 
searching word "car", it doesn't make sense that "the deepest child generation is processed first", 
because it is not necessary to go the deepest child (level 5 in this case) in a tree for the traversal. 

Regarding claim 10, the limitation of "a set of traversal rules" lacks antecedent bases 
and/or clear description in the specification (the closet disclosure is referred on page 5, line 17). 

Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or 
described as set forth in section 102 of this title, if the differences between the subject 
matter sought to be patented and the prior art are such that the subject matter as a whole 
would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 

4. Claims 1, 3 and 5 -16 are rejected under 35 U.S.C. 103(a) as being unpatentable over Kao 
(USPN 6,374,222 Bl), in view of Mitchell et al. (USPN 6,574,595), hereinafter referenced as 
Mitchell. 

As per claim 1, as best understood in view of claim objection (see above), Kao discloses 
a method of memory management in speech recognition, for reducing the size of memory 
required in speech recognition searching (abstract), comprising: 

a tree data structure implemented in a computer-readable memory accessible by a 
processor, said tree data structure having plurality of nodes that topologically define a root node 
and a plurality of parent-child generations, including a deepest child generation that is 
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topologically furthest from the root (column 3, lines 2-5 and Fig. 1, 'computer/comparator 10b' 
and 4 memory 10c'; column 6, line 37, 'digital signal processor'; column 2, line 40 and column 8, 
line 9, 'search tree' and 'node' equivalent to 'slot', also see Fig. 5); and 

a traversal algorithm implemented by said processor , said algorithm traversing said 
nodes based on a set of traversal rules, (column 6, lines 37-38, 'Digital Signal Processor 
implementation'; column 4, lines 1-67 and column 9, lines 10-45, 'a structure called slot (herein 
equivalent to node)' and 'search algorithm', including the fields of indexes and pointers and the 
algorithm related requirement, grammar, timing and condition (herein broadly interpreted as a set 
of traversal rules); and column 5, lines 61-67 and Fig.4, 'traverse down the search space'), 
"whereby nodes of a given generation are processed before the parent nodes of said given 
generation are processed", and "traversal among nodes of each generation proceeds in the same 
topological direction", (column 4, lines 58-60, 'propagate the current time stamp backward 
through the whole path (a path is a backward linked list of slots)', which suggests that a child 
generation is processed before its parent node with a backward direction). 

But, Kao does not expressly disclose that during the traversal algorithm "the deepest 
child generation is processed first". However, this feature was well know in the art as evidenced 
by Mitchell, who discloses a beam search algorithm (herein equivalently interpreted as to 
traversal algorithm) with a linked list known as the decoding tree (column 3, line 52 to column 4 
line 6). Kao further teaches that at end of the spoken utterance (herein corresponding to the 
deepest child generation in the process), the best scoring ending phoneme is used to retrieve the 
most likely phoneme sequence by traversing through the list of corresponding pointer entries in 
the decoding tree and this process is commonly referred to as backtracking (column 4, lines 6- 
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11). Therefore, it would have been obvious to one of ordinary skill in the art at time the 
invention was made to modify Kao by specifically providing a backtracking approach for 
traversing through the list, as taught by Mitchell, for the purpose of obtaining a global best path 
(Mitchell: column 4, line 52) for a speech recognition system. 

As per claim 3, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 1). Kao in view of Mitchell further teaches that said tree data structure is encoded in said 
memory with parent-child generations being represented through linked list, (Kao: column 2, line 
4 and column 4, line 60; and column 4, lines 12-24, 'slot (node)' 'structure', also see Fig. 5). 

As per claim 5, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 1). Kao in view of Mitchell further teaches a mechanism for designating selected ones of 
said nodes as active nodes, (column 3, lines 55-59 'lexicon HMM' and 'active state (herein 
equivalent to active node)'). 

As per claim 6, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 5). Kao in view of Mitchell defines a slot (note) structure for the search network (Kao: 
column 4, lines 7-20 and column 9, lines 10-18), and the list of "viable" phoneme sequences is 
updated and stored as a linked list (herein interpreted as active envelope data structure) also 
known as the decoding tree, in which each node corresponds with a particular active phoneme of 
the phone network (Mitchell: column 4, lines 2-6), which corresponds to the claimed "said 
mechanism for designating selected ones of said nodes as active nodes comprises an active 
envelope data structure associated with said tree data structure." 

As per claim 7, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 1). Kao in view of Mitchell further a mechanism for designating selected ones of said 
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nodes as active nodes (Kao: column 3, lines 55-59, iexicon HMM' and 'active state (herein 
equivalent to active node)'); and wherein said traversal algorithm includes a traversal rules 
whereby only said active nodes are traversed, (Mitchell: column 3, lines 52-53, 'a beam search 
algorithm (herein equivalently interpreted as to traversal algorithm) only searches the active 
portion of the phone network'; column 4, lines 2-6, 'the list of "viable" phoneme sequences is 
updated and stored as a linked list also known as the decoding tree, in which each node 
corresponds with a particular active phoneme of the phone network'). 

As per claim 8, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 1). Kao in view of Mitchell further discloses said tree data structure is a lexical tree 
representing a lexicon (column 2, lines 1-26, 'lexical tree', 'pronunciation grammar'; and 
column 3, lines 55-59 'lexicon HMM'). 

As per claim 9, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 1). Kao in view of Mitchell further discloses said tree data structure is a lexical tree 
representing the lexicon of a speech recognizer (column 2, lines 1-26, 'lexical tree', 
'pronunciation grammar'; and column 3, lines 32-59, 'a speech recognition system (equivalent to 
speech recognizer)', 'lexicon HMM'), 

As per claim 10, as best understood in view of claim objection (see above), Kao discloses 
a method of memory management in speech recognition, for reducing the size of memory 
required in speech recognition searching (abstract), comprising: 

a tree data structure implemented in a computer-readable memory accessible by a 
processor, said tree data structure having plurality of nodes (column 3, lines 2-5 and Fig. 1, 
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'computer (inherent include processor)/comparator 10b' and 'memory 10c'; column 2, line 40 
and column 8, line 9, 'search tree' and 'node' equivalent to 'slot', also see Fig. 5); 

a mechanism for designating selected ones of said nodes as active nodes (column 3, lines 
55-59, 'lexicon HMM' and 'active state (herein equivalent to active node)'); and 

a traversal algorithm implemented by said processor, said algorithm traversing said nodes 
based on a set of traversal rules (column 6, lines 37-38, 'Digital Signal Processor 
implementation'; column 5, lines 61-67 and Fig.4, 'traverse down the search space'; column 4, 
lines 1-67, 'defining the computer data structure and implementing the algorithm', 'search 
algorithm'). 

But, Kao does not expressly disclose that during the traversal "only said active nodes are 
traversed". However, this feature was well know in the art as evidenced by Mitchell, who 
discloses that a beam search algorithm (herein equivalently interpreted as to traversal algorithm) 
only searches the active portion of the phone network (column 3, lines 52-53), and the list of 
"viable" phoneme sequences is updated and stored as a linked list also known as the decoding 
tree, in which each node corresponds with a particular active phoneme of the phone network 
(column 4, lines 2-6). Therefore, it would have been obvious to one of ordinary skill in the art at 
time the invention was made to modify Kao by specifically using beam search algorithm for 
traversing only active nodes (equivalent to active states) of the tree structure, as taught by 
Mitchell, for the purpose of reducing search complexity (Mitchell: column 3, lines 53-54) for a 
speech recognition system. 

As per claim 11, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 10). Kao in view of Mitchell defines a slot (note) structure for the search network (Kao: 
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column 4, lines 7-20 and column 9, lines 10-18), and the list of "viable" phoneme sequences is 
updated and stored as a linked list (herein interpreted as active envelope data structure) also 
known as the decoding tree, in which each node corresponds with a particular active phoneme of 
the phone network (Mitchell: column 4, lines 2-6), which corresponds to the claimed "said 
mechanism for designating selected ones of said nodes as active nodes comprises an active 
envelope data structure associated with said tree data structure " 

As per claim 12, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 10). Kao in view of Mitchell further discloses that said traversal algorithm includes a 
dynamic programming process that assigns a likelihood score to nodes that are traversed 
(Mitchell: column 3, lines 41-53, 'highest likelihood score' and 'dynamic programming using 
Viterbi algorithm 5 ). 

As per claim 13, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 12). Kao in view of Mitchell further discloses that said mechanism for designating 
selected ones of said nodes uses said likelihood score to designate said active nodes (Mitchell: 
column 2, lines 12-24, 'computing likelihood score for all active sub-word (herein equivalent to 
active node) models'; column 2, lines 12-24, 'there is change in the local best path which is 
based on the cumulative likelihood score of the phoneme sequence'). 

As per claim 14, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 10). Kao in view of Mitchell further discloses the beam search algorithm (herein 
equivalently interpreted as traversal algorithm) for active portion of the phone network, 
including activating all valid phonemes, dynamic programming by using Viterbi algorithm, 
pruning unlikely phoneme sequences that have a lower cumulative likelihood score than a 
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prescribed value (predetermined thresholds) (Mitchell: column 3, lines 52-65), which 
corresponds to the claimed "said traversal algorithm includes a dynamic programming process 
that assigns a likelihood score to nodes that are traversed and wherein nodes are designated as 
active nodes if their likelihood score is above a predetermined threshold " 

As per claim 15, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 14). Kao in view of Mitchell further teaches a prescribed value relative to the current best 
cumulative score (herein equivalently interpreted as highest likelihood score) (Mitchell: column 
3, lines 62-4), which corresponds to the claimed "said predetermined threshold is calculated 
based on the highest likelihood score." 

As per claim 16, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 10). Kao in view of Mitchell discloses a slot (note) structure for the search network (Kao: 
column 4, lines 7-20 and column 9, lines 10-18) that is capable of evaluating and linking active 
states (Kao: column 5, lines 1-7); an example of the expansion (herein interpreted as propagate) 
from phone to next phone (Kao: column 5, lines 11-19 and Fig. 4); and the list of "viable" 
phoneme sequences is updated and stored as a linked list (herein interpreted as active envelope) 
also known as the decoding tree, in which each node corresponds with a particular active 
phoneme of the phone network (Mitchell: column 4, lines 2-6) and the beam searching algorithm 
under the constraints (herein interpreted as a set of rules, including removing those phonemes 
that likelihood score lower than a prescribed value (Mitchell: column 3, lines 44-65); which 
corresponds to the claimed "said a mechanism for designating selected ones of said nodes as 
active nodes defines an active envelope and uses a set of rules to propagate the active envelope 
by removing nodes that have a likelihood score below a predetermined threshold." 
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Claims 2, 4 and 17-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kao in view of Mitchell and further in view of well known prior art (MPEP 2144.03). 

As per claim 2, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 1). Kao in view of Mitchell fails to expressly disclose that the "said tree data structure is 
encoded in said memory as a flat representation in which nodes of each generation occupy 
contiguous memory locations". However, the examiner takes official notice that this feature was 
well known in the art, because conventional breath-firth traversal algorithm is generally used for 
storing nodes of each generation in contiguous memory location. 

Therefore, it would have been obvious to one of ordinary skill in the art at time the 
invention was made to modify Kao in view of Mitchell by specifically providing a memory 
arrangement same as or similar to that of the conventional breath- firth traversal algorithm, for 
the purpose of increasing processing efficiency. 

As per claim 4, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 1). Kao in view of Mitchell further discloses a slot (node) using C (language) structure 
that has fields of indexes and pointers (Kao: column 4, lines 12-24), which are used for linking 
its parent and/or child, and also inherently used for indicia, such as slot_pointer = null or 
index_integer = 0 stands for a boundary, which corresponds to the claimed "the notes . . . have 
indicia designating the topological boundary between children of the same parent". But Kao in 
view of Mitchell fails to expressly disclose that the "said tree data structure is encoded in said 
memory as a flat representation in which nodes of each generation occupy contiguous memory 
locations". However, the examiner takes official notice that this feature was well known in the 
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art, because conventional breath- firth traversal algorithm is generally used for storing nodes of 
each generation in contiguous memory location. 

Therefore, it would have been obvious to one of ordinary skill in the art at time the 
invention was made to modify Kao in view of Mitchell by specifically providing a memory 
arrangement same as or similar to that of the conventional breath- firth traversal algorithm, for 
the purpose of increasing processing efficiency. 

As per claim 17, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 10). Kao in view of Mitchell further discloses a slot (note) structure for the search network 
(Kao: column 4, lines 7-20 and column 9, lines 10-18) that is capable of evaluating and linking 
active states (Kao: column 5, lines 1-7); an example of the expansion (herein interpreted as 
propagate) from phone to next phone (Kao: column 5, lines 11-19 and Fig. 4); and the list of 
"viable" phoneme sequences is updated and stored as a linked list (herein interpreted as active 
envelope) also known as the decoding tree, in which each node corresponds with a particular 
active phoneme of the phone network (Mitchell: column 4, lines 2-6) and the beam searching 
algorithm under the constraints (herein interpreted as a set of rules) (Mitchell: column 3, lines 
44-65); which corresponds to the claimed "said a mechanism for designating selected ones of 
said nodes as active nodes defines an active envelope and uses a set of rules to propagate the 
active envelope". But, Kao in view of Mitchell fails to expressly disclose that the "mechanism 
uses a set of rules to propagate the active envelope by inserting nodes that have a likelihood 
score above a predetermined threshold". However, the examiner takes official notice that this 
feature was well known in the art, because inserting nodes on a linked list based structure is 
widely used in data structure design in computer applications, thus Kao in view of Mitchell is 
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capable of inserting node in a link list (Kao: column 6, lines 1-2, 'add at least one slot (node) to 
the search path, and Mitchell: column 3, lines 44-65, 'phoneme ... are removed'), without any 
difficulty. 

Therefore, it would have been obvious to one of ordinary skill in the art at time the 
invention was made to modify Kao in view of Mitchell by specifically providing a mechanism 
for inserting nodes in an active node link list, for the puipose of implementing an alternative way 
for a link list in a search algorithm. 

As per claim 18, Kao and Mitchell and well-known prior art disclose everything claimed, 
as applied above (see claim 17). Kao in view of Mitchell further discloses dynamic memory for 
building a searching tree by using RAM (Kao: column 1, lines 23-25); a slot (note) structure for 
the search network with fields of indexes and pointers (herein interpreted topological index, and 
inherently can be used for sorting), and execution requirements including grammar, timing and 
condition (herein interpreted as a set of rules) (Kao: column 4, lines 7-67 and column 9, lines 10- 
45), which suggests that the combined system is capable of implementing the functionality as 
claimed "said set of rules for inserting nodes guarantees that the nodes in said active envelope 
are sorted by their topological index." 

As per claim 19, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 1). Kao in view of Mitchell dose not expressly disclose that the "said processor employs a 
cache and wherein said wherein said tree data structure is encoded in said memory such that 
traversal of said tree proceeds into said cache". However, the examiner takes official notice that 
this feature was well known in the art, since caching technique for both hardware structure and 
software arrangement was widely used in signal processing art and computer related art. 
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Therefore, it would have been obvious to one of ordinary skill in the art at time the invention was 
made to modify Kao in view of Mitchell by specifically providing caching technique for both 
hardware structure and software arrangement, for the purpose of reducing processing time. 

As per claim 20, Kao and Mitchell disclose everything claimed, as applied above (see 
claim 10). In addition, the rejection is based on the same reason described for claim 19 because 
claim 20 recites same or similar limitation(s) as claim 19. 



Conclusion 

5. Any response to this office action should be mailed to: 

Commissioner of Patents and Trademarks, P.O. Box 1450, Alexandria, VA223 13-1450 
or faxed to: 

(703)-872-9314 
Hand-delivered responses should be brought to: 

Crystal Park II, 2121 Crystal Drive, Arlington. VA. Sixth Floor (Receptionist). 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Qi Han whose telephone numbers is (703) 305-563 1. The 
examiner can normally be reached on Monday through Thursday from 8:00 a.m. to 5:30 p.m. and 
Friday from 8:00 a.m. to 12:00 a.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil, can be reached on (703) 305-6954. 

Any inquiry of a general nature of relating to the status of this application or proceeding 
should be directed to the Technology Center 2600 Customer Service Office whose telephone 
number is (703) 306-0377. 



QH/qh 

August 25, 2003 



Richemond Dorvil 
Primary Examiner 



